A Survey of Results on Random Random 
Walks on Finite Groups 

Martin Hildebrand 
Department of Mathematics and Statistics 
University at Albany 
State University of New York 
Albany, NY 12222 

February 1, 2008 

Abstract 

A number of papers have examined various aspects of "random 
random walks" on finite groups; the purpose of this article is to pro- 
vide a survey of this work and to show, bring together, and discuss 
some of the arguments and results in this work. This article also pro- 
vides a number of exercises. Some exercises involve straightforward 
computations; others involve proving details in proofs or extending re- 
sults proved in the article. This article also describes some problems 
for further study. 

1 Introduction 

Random walks on the integers Z are familiar to many students of probability. 
(See, for example, Ch. XIV of Feller, volume 1 |Hj, Ch. XII of Feller, volume 

2 [Oj, or Ross |2*T]). Such random walks are of the form Xq, X%, X%, ■ ■ ■ where 
X = and X m = Zi + . . . + Z m where Zi, Z 2 , . . . are independent, identically 
distributed random variables on Z. A commonly studied random walk on Z 
has PiZi = 1) = P(Zi = —1) = 1/2. Various questions involving such 
random walks have been well studied. For example, one may ask what is the 
probability that there exists an m > such that X m = 0. In the example 
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with P(Zi = 1) = P(Zi = — 1) = 1/2, it can be shown that this probability is 
1. (See jSj, P- 360.) For another example, one can use the DeMoivre-Laplace 
Limit Theorem to get a good approximation of the distribution of X m for 
large m. 

One can examine random walks on sets other then Z. For instance, there 
are random walks on Z 2 or Z 3 . A symmetric random walk on Z 2 has X = 
(0,0) and P(Z t = (1,0)) = P(Z t = (-1,0)) = P(Z t = (0,1)) = P(Z t = 
(0,-1)) = 1/4 while a symmetric random walk on Z 3 has Xq = (0,0,0) 
and P(Z t = (1,0,0)) = P(Zi = (-1,0,0)) = P(Z { = (0,1,0)) = P(Z { = 
(0, -1, 0)) = P(Z, = (0, 0, 1)) = P(Z, = (0, 0, -1)) = 1/6. It can be shown 
for this random walk on Z 2 , the probability that there exists an m > such 
that X m = (0, 0) is 1 while for this random walk on Z 3 , the probability that 
there exists an m > such that X m = (0,0,0) is less than 1. (See pp. 
360-361 of jH] for a description and proof. Feller attributes these results to 
Polya JH] and computation of the probability in the walk on Z 3 to McCrea 
and Whipple [TF].) 

One can similarly look at random walks on Z n , the integers modulo n, 
where n is a positive integer. Like the walks on the integers, the random walk 
is of the form X , Xi, X 2 , . . . where X = and X m — Z\ + . . . + Z m where 
Z\, Z2, . . . are i.i.d. random variables on Z„. One example of such a random 
walk has PiZ^ = 1) = PiZi = —1) = 1/2 and n being an odd positive 
integer. This random walk on Z n corresponds to a finite Markov chain which 
is irreducible, aperiodic, and doubly stochastic. (For more details on this 
notation, see Ross [21]-) Thus the stationary probability for this Markov 
chain will be uniformly distributed on Z n . (If P is a probability uniformly 
distributed on Z n , then P(a) — 1/n for each a G Z„.) Furthermore, after a 
large enough number of steps, the position of the random walk will be close 
to uniformly distributed on Z n . 

One may consider other probabilities on Z n for Z\ in the random walk. 
For example, on Ziooo, we might have P(Zi = 0) = P(Zi = 1) = PiZi = 
10) = P(Zi = 100) = 1/4. Again Markov chain arguments can often show 
that the stationary distribution for the corresponding Markov chain will be 
uniformly distributed on Z n and that after a large enough number of steps, 
the position of the random walk will be close to uniformly distributed on 
Ziooo- A reasonable question to ask is how large should m be to ensure that 
X m is close to uniformly distributed. 

One may generalize the notion of a random walk to an arbitrary finite 
group G. We shall suppose that the group's operation is denoted by mul- 
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tiplication. The random walk will be of the form X ,X 1 ,X 2 , . . . where X 
is the identity element of G, X m = Z m Z m _ x . . . Z 2 Zi, and Zx,Z 2) ... are 
i.i.d. random variables on G. (A random variable X on G is such that 
Pr(X — g) > for each g 6 G and X] g eG-^' r (^ = 9) = !•) An alternate 
definition of a random walk on G has X m = Z\Z 2 ■ ■ ■ Z m _iZ m instead of 
X m = Z m Z m _i . . . Z 2 Z\. If G is not abelian, then the different definitions 
may correspond to different Markov chains. However, probabilities involving 
X m alone do not depend on which definition we are using. 

An example of a random walk on S n , the group of all permutations 
on {l,...,n}, has P(Zi = e) = 1/n where e is the identity element and 
P(Zi = t) = 2/n 2 for each transposition r. Yet again, Markov chain ar- 
guments can show that after a large enough number of steps, this random 
walk will be close to uniformly distributed over all n\ permutations in S n . 
Again a reasonable question to ask is how large should m be to ensure that 
X m is close to uniformly distributed over all the permutations in S n . This 
problem is examined in Diaconis and Shahshahani jl] and also is discussed 
in Diaconis 0. 

A number of works discuss various random walks on finite groups. A cou- 
ple of overviews are Diaconis' monograph [3 and Saloff-Coste's survey 

In this article, we shall focus on "random random walks" on finite groups. 
To do so, we shall pick a probability for Z^ at random from a set of probabil- 
ities for Zj. Then, given this probability for Zj, we shall examine how close 
X m is to uniformly distributed on G. To measure the distance a probability 
is from the uniform distribution, we shall use the variation distance. Often, 
we shall look at the average variation distance of the probability of X m from 
the uniform distribution; this average is over the choices for the probabilities 
for Zj. The next section will make these ideas more precise. 



2 Notation 



If P is a probability on G, we define the variation distance of P from the 
uniform distribution U on G by 



\P-U\\ 



-Y. 



Pis) 



1 

W\ 



Note that U(s) = 1/\G\ for all s e G. 
EXERCISE. Show that IIP - U\\ < 1. 
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EXERCISE. Show that 



\\P-U\\=mg\P(A)-U(A)\ 

where A ranges over all subsets of G. (Note that A does not have to be a 
subgroup of G.) 

A random variable X on G is said to have probability P if P(s) = Pr(X = 
s) for each s G G. 

If P and Q are probabilities on G, we define the convolution of P and Q 

by 

P*Q(s)=5>(*)Q(rt). 

tea 

Note that if X and Y are independent random variables on G with proba- 
bilities P and Q, respectively, then P * Q is the probability of the random 
variable XY on G. 

If m is a positive integer and P is a probability on G, we define 

p*m — p ^ p*(m-l) 



where 

p *o (s) fl ifa = e 
1 otherwise 

with e being the identity element of G. Thus if Z±, . . . , Z m are i.i.d. random 
variables on G each with probability P, then P* m is the probability of the 
random variable Z m Z m _i . . . Z 2 Zi on G. 

For example, on Z 10 , suppose P(0) = P(l) = P(2) = 1/3. Then P* 2 (0) = 
1/9, P* 2 (l) = 2/9, P* 2 (2) = 3/9, P* 2 (3) = 2/9, P* 2 (4) = 1/9, and P* 2 (s) = 
for the remaining elements s G Ziq. Furthermore 
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EXERCISE. Let Q be a probability on Z 10 . Suppose Q(0) = Q(l) 
(5(4) = 1/3. Compute Q* 2 and \\Q* 2 - U\\. 
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EXERCISE. Consider the probability P in the previous example and the 
probability Q in the previous exercise. Compute P* 4 , Q* 4 , ||P* 4 — U\\, and 

\\Q* 4 -u\\. 

Let ai, 02, . . . flfc € C Suppose pi, . . . ,pk are positive numbers which sum 
to 1. Let 



^oi,... )afc (s) = J2 Pb5s > 

where 



0(, 

6=1 



3s,a b 



1 if S = Ofe 

otherwise. 

The random walk X , Xi, X 2 , . . . where Z±, Z 2 , . . . are i.i.d. random variables 
on G with probability P ai ,...,a k is said to be supported on (ai, . . . , a^). 
If we know k and Pi, ■ ■ ■ ,Pk, then in theory we can find 

IT ai,...,a fc w II 

for any fc-tuple (ai, . . . , a&) and positive integer m. Thus if we have some 
probability distribution for (ai, . . . , a^), we can in theory find 

E{\\PZ.,a k -U\\) 

for each positive integer m since this variation distance is a function of the 
random Axtuple (ai, . . . , a^). 

In a random random walk, a typical probability for Zi will be P ai ,...,a k 
where p\ — p 2 — ■ ■ ■ — Pk — 1/k and (ai, a 2 , ... , a^) chosen uniformly over 
all /c-tuples with distinct elements of G. However, other probabilities for Zi 
sometimes may be considered instead. 

For example, on Z 5 , suppose we let p\ = p 2 = P3 = 1/3 and we choose 
(01,02,03) at random over all 3-tuples with distinct elements of Z 5 . Then 

^(ll^aa-^ID = ^(\\^-n + \\PS?fl-U\\ + \\PS? A -U\\ 

+ \\PoKs ~ U\\ + ||P A4 - ^ II + TO - U\\ 

+II^As " U\\ + \\P$ A - U\\ + \\Pll, - U\\ 

+ \\P2^-U\\). 

Note that we are using facts such as Po,i,2 = -P,i,o — Pl, 2,0 since pi = P2 = 
p 3 = 1/3; thus we averaged over 10 terms instead of over 60 terms. 
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We shall often write E(\\P* m - U\\) instead of E(\\P*™ ak - U\\). 

Often times we shall seek upper bounds on E(\\P* m — U\\). Note that 
by Markov's inequality, if E(\\P* m - U\\) < u, then Pr(\\P* rn - U\\ > cu) < 
1/c for c > 1 where the probability is over the same choice of the fc-tuple 
(ax, ... , dk) as used in determining E(\\P* m — U\\). 

Lower bounds tend to be found on ||P* m — U\\ for all a±, . . . , a^, and we 
turn our attention to some lower bounds in the next section. 

EXERCISE. Compute P(||P* 4 - U\\) if G = Z u , k = 3, Pl = p 2 = 
P3 = 1/3, and (ai, a 2 , 0-3) are chosen uniformly from all 3-tuples with distinct 
elements of G. It may be very helpful to use a computer to deal with the 
very tedious calculations; however, it may be instructive to be aware of the 
different values of ||P* 4 — U\\ for the different choices of a±, a 2 , and a 3 . In 
particular, what can you say about \\P^ a2ja3 - U\\ and ||Po^a-oi,aa-ai ~ ^ll 7 

Throughout this article, there are a number of references to logarithms. 
Unless a base is specified, the expression log refers to the natural logarithm. 

3 Lower bounds 

3.1 Lower bounds on Z n with k = 2 

In examining our lower bounds, we shall first look at an elementary case. 
Suppose G = Z n . We shall consider random walks supported on 2 points. 
The lower bound is given by the following: 

Theorem 1 Suppose pi = p 2 = 1/2. Let e > be given. There exists values 
c > and N > such that if n > N and m < cn 2 , then 

lip*™ _ > 1 _ e 
11 J 01,02 11 

for all ai and a 2 in G with a\ ^ a 2 . 

Proof: Let F m = \{i : 1 < i < m, Z{ = cii}|, and let S m — \{i : 1 < 
i < m, Zi = a 2 }\. In other words, if we perform m steps of the random walk 
supported on (ai,a 2 ) on Z n , we add a\ exactly F m times, and we add a 2 
exactly S m times. Note that F m + S m = m and that X m = F m ai + S m a 2 . 
Observe that E(F m ) = m/2. Furthermore, observe that by the DeMoivre- 
Laplace Limit Theorem (see Ch. VII of jH], for example), there are constants 
Zi, z 2} and Ni such that if n > N±, then Pr(m/2 — zi^/rn/4 < F m < 
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m/2 + Z2\/m/A) > l — e/2. Furthermore, there exists a constant c such that 
if m < cn 2 and n > Ni, then (e/6)n > sj~mj\ and Pr(m/2 — (e/Q)n < F m < 
m/2 + (e/6)n) > 1 - e/2. Let A m = {F m ai + (m - F m )a 2 : m/2 - (e/6)n < 
F m < m/2+(e/6)n}. ThusP* m (A m ) > l-(e/2). However, |A m | < (e/3)n+l. 
Thus if n > Ni and m < cn 2 , then 

2 ~ (3 + n) 
5e 1 
6 n 

Let N = max(iVi, 6/e). If n > N and m < cn 2 , then ||P* m - U\\ > 1 - e. □ 
EXERCISE. Modify the above theorem and its proof to consider the case 
where < p\ < 1 is given and P2 = 1 — pi ■ 



P* m -U\\ > 1- 
= 1 - 



3.2 Lower bounds on abelian groups with k fixed 

Now let's turn our attention to a somewhat more general result. This result 
is a minor modification of a result of Greenhalgh [TOj. Here the probability 
will be supported on elements a\, a 2 , . . . , a^. One similarity to the proof of 
the previous theorem is that we use the number of times in the random walk 
we choose to be a\, the number of times we choose Zj to be a 2 , etc. 

Theorem 2 Let p\ = p 2 = . . . = pj. = 1/k. Suppose G is an abelian group 
of order n. Assume n > k > 2. Let 5 be a given value under 1/2. Then there 
exists a value 7 > such that if m < ^n 2 ^ k ' l \ then HP*™ ak — U\\ > 5 for 
any k distinct values a\, a 2 , ■ ■ ■ G G. 

Proof: This proof slightly modifies an argument in Greenhalgh [TP] . 
That proof, which only considered the case where G = Z n , had 5 = 1/4 but 
considered a broader range of pi,p 2 , ... ,Pk- 

Since G is abelian, X m is completely determined by the number of times 
Ti we pick each element a^. Observe that r\ + . . . + = m. Thus if g = 
nai + . . . + r k a k , we get 

777 I 

P* m (9) > Q m {r) :- 



lt=i(# 



where r — (r 1; . . . , r&). (Note that we may use P* m instead of P £ 



*m \ 
Oi, ...,a k ■ I 
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Suppose \ri — m/k\ < a.i\[m for i — 1, . . . , k. Then 

i— n Am(l/Jfe)(l - l/k) 

Pr(\ri-m/k\<aiVm,i = l,...,k) > 1 - ^ — 



afm 
i=i 1 

\{l/k)_ 



1 A (l/fc)(l-l/fc) 



i=l 

> 2(5 

where we assume on are large enough constants to make the last inequality 
hold. 

Let R = {r : r\ + . . . + r k = m and |rj — m//c| < a iv /m for i = 1, . . . , A;}, 
and let A m = {r l0l + . . . + r fc a fc : (n, . . . , r fc ) G £}. Thus P* m (A m ) > 25. 

— * 

Observe that, with e m (r) — > uniformly over r G -R as m — > oo, we have, 
by Stirling's formula, 



Q m (r)m 



(fc _ 1)/2 m( fc - 1 )/ 2 e- m m m ^S:(l + e m (r)) 



nti ^e-^r[ l v^ 

e~ m m m 1 l + e m (f) 



exp(-Eti^) nti(^)- (aj M^V 2 

1 11 + e m (f) 



provided that all of the values r±, . . . ,r k are positive integers. 

It can be shown that Y\i=i \AV m ~^ (l/k) k ^ 2 uniformly over r £ R as 
m — > oo. 

Now let Xi = Ti — m/k; thus kr\ = kxi + m. Note that x\ + . . . + x k = 
since r\ + . . . + r k = m. Observe that 

k * / kx^ m/k+x 



i=i x ' «=i 



£(i-M 1+ ^) 



= exp 



Now observe 



i=i x 7 



(^-w) +f{m > xi >---> xk) 

i=l x ' 

i=i 



where for some constant Ci > 0, |/(m, x±, . . . , x k ) \ < C\j \fm for all r G R. 
So for some constant C 2 > 0, 



f(m,x u ...,x k )- 1 1 ' ' 



2m 2 



C 2 

< 



m 



for all r G P. 

Thus for some constant a > and some integer M > 0, we have 

Q m (r)m (fc_1)/2 > a 

for all f G R and m > M. (We may also assume that M is large enough 
that m/k > ai^fm if m > M. Thus if m > M, we have r\ > for all r£ P.) 
Now suppose that 

a 2 

m (k-l)/2 — n 

Thus if c/ G A m , P* m (#) > a/m^- 1 )/ 2 > 2/n and P* m (#)-(l/n) > P* m (g)/2. 
Thus P* m (A m ) - C/(A m ) > 0.5P* m (A m ) > 5, and so 

\\p:™., ak -u\\>6 

if m < (a/2) 2 /( fe ~ 1 )n 2 /( fc - 1 ) and m > M. The following exercise shows 
that the above reasoning suffices if M < (a/2) 2 ^ k ~ 1 ^n 2 ^ k ~ 1 \ i.e. n > 
{2/a)M ik -^/ 2 . 

EXERCISE. If P and Q are probabilities on G, show that \\P*Q-U\\ < 
\\P - U\\. Use this result to show that if m 2 > m u then ||P* m2 - U\\ < 
\\P* mi -U\\. 

For smaller values of n > k, observe that ||P*° — U\\ — 1 — 1/n > 5, and 
we may choose 71 such that 7iiY 2/(fe_1) < 1 where N = (2/a)M (fe_1)/2 . Let 
7 = min(7i, (a/2) 2 /( fc_1 )). Note that this value 7 does not depend on which 
abelian group G we chose. □ 

EXERCISE. Extend the previous theorem and proof to deal with the case 
where p±, . . . ,p k are positive numbers which sum to 1. 
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EXERCISE. Extend the previous theorem and proof to deal with the case 
where 5 is a given value under 1. (Hint: If 5 < 1/b where b > 1, replace "25" 
by "65" and replace "2/n" by an appropriate multiple of 1/n.) 



3.3 Some lower bounds with k varying with the order 
of the group 

Now let's look at some lower bounds when k varies with n. The following 
theorem is a rephrasing of a result of Hildebrand 



Theorem 3 Let G be an abelian group of order n. If k = |_(logn) a J where 
a < 1 is a constant, then for each fixed positive value b, there exists a function 
f{n) such that fin) — > 1 as n — > oo and ||P* m „ — U\\ > f(n) for each 
(di, . . . , afc) G G where m = [(\ogn) J . 



Proof: The proof also is based on material in [M]. In the first m steps 
of the random walk, each value a« can be picked either times, 1 time, . . . , 
or L(logn) fe J times. Since the group is abelian, the value X m depends only 
on the number of times each <2j is picked in the first m steps of the random 
walk. So after m steps, there are at most (1 + [(logn) 6 J) fc different possible 
values for X m . The following exercise implies the theorem. 

EXERCISE. Prove the following. If k = |_(logn) a J and a < 1 is a con- 
stant, then 

(l + l(logn) b \) k ;Q 
n 

as n — » oo. 

Note that the function / may depend on b but does not necessarily depend 
on which abelian group G we chose. □ 
The following lower bound, mentioned in ^3], applies for any group G. 

Theorem 4 Let G be any group of order n. Suppose k is a function of n. 
Let e > be given. If 

,logn 
log/c 

then Hi^i"!.. a h ~ U\\ > f(n) for each (ai, . . . , a&) G G k and some f(n) such 
that f(n) — ► 1 as n — » oo. 



Proof: Note that X m has at most k m possible values and that k m < n 

ai,...,a k 



1-e 



Thus ||P a * m . a . -U\\>1- {n l - e /n). Let f(n) = 1 - {n l ' e /n). □ 
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If k = [(logn) a \ and a > 1 is constant, then the previous lower bound 
can be made slightly larger for abelian groups. The following theorem is a 
rephrasing of a result in Hildebrand [Tlj . 



Theorem 5 Let G be an abelian group of order n. Suppose k = |_(logn) a J 
where a > 1 is a constant. Let e > be given. Suppose pi — . . . = pk — 1/k. 
Suppose 

m = 1 — e) . 

L a-llog£; V ;J 

Then for some f{n) such that f{n) — ► 1 as n — > oo, ll-Pa™.. a . — ?7|| > /(ti) 
/or all (ai, . . . , a^) sitcA t/iat a 1; . . . , are distinct elements of G. 

Proof: The proof of this theorem is somewhat trickier than the previous 
couple of proofs and is based on a proof in jHj. We shall find functions g(n) 
and h(n) such that g(n) — > and /i(n) — > as n — > oo and the following holds. 
Given (d, . . . , a*.) e G k , there exists a set A m such that P*™ (An) > 
1 - g(n) while U(A m ) < h(n). 

To find such a set v4 m , we use the following proposition. 

Proposition 1 Let R = {j : 1 < j < m and Zj = for some i < j}. 
Then there exist functions fi(n) and f2{n) such that f\{n) ^ as n — ► oo ; 
h{n) — > as n — > oo, and Pr(|i?| > /x(n)m) < f2(n). 

Proof: First note PriZj = Zi for some i < j) < (j — l)/k. Thus 
^™ =1 Pr(Zj = Zj for some i < j) < m 2 /k. Thus P(|i?|) < m 2 /k. Thus by 
Markov's inequality, 

Pr(|P| > A(n)m) < 



fi(n)m h{n)k 

for any function fi(n) > 0. Since m/k — > as n — > oo, we can find a function 
/i(n) — > as n — > oo such that ^(tV) := m/(fi(n)k) — > as n — > oo. □ 
Let A m = {Z m Z m _i . . .Z\ such that |{j : 1 < j < m and Zj = Z; L for 
some i < j}\ < /i(n)m}. So by construction, 

^J4»)>1 -/*(»)• 

Now let's consider U(A m ). There are k m different choices overall for 
Zi, Z 2 , . . . , Z m . Observe that for each X m 6 A m , there is at least one way to 
obtain it after m steps of the random walk such that the values Zj, . . . , Z*. 
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have m — \f\(n)m\ distinct values. Rearranging these distinct values does 
not change the value X m since G is abelian. Thus each X m is obtained by 
at least (m — \ fi(n)m})\ different choices in the walk. Thus A m has at most 
k m /(m — \ fi(n)m])\ different values. The following exercise completes the 
proof of the theorem. 

EXERCISE. Show that for the values m and k in this theorem and for 
any function fi{n) > such that f\(n) — > as n — > oo, 

k m /(m- \h{n)m\)\ 
n 

as n — > oo. (Hint: Use Stirling's formula to show that (m — \fi{n)m\)\ is 
n (i-e)(i-c/i(n))/(a-i) f or some function gi(n) — > as n — > oo, and search for 

terms which are insignificant when one expresses k m in terms of n.) 

□ 

Note that the function f(n) in the previous theorem does not have to 
depend on the which group G of order n we have. 

4 Upper bounds 

We now turn our attention to upper bounds for the random random walks 
on finite groups. Usually these bounds will refer to the expected value of the 
variation distance after m steps. This expected value, as noted in an earlier 
section, is over the choice of the /c-tuple (oi, . . . , a^). First we shall look at 
a lemma frequently used for upper bounds involving random walks on finite 
groups as well as random random walks on finite groups. 

4.1 The Upper Bound Lemma of Diaconis and Shahsha- 
hani 

This lemma uses techniques from Fourier analysis on finite groups. A more 
extensive summary of this technique appears in Diaconis [3]. There are a 
number of sources which describe Fourier analysis on finite groups (e.g. Ter- 
ras and representation theory of finite groups (e.g. Serre or Si- 
mon |2Ij)- 

A representation p of a finite group G is a function from G to GL n (C) 
such that p(st) = p(s)p(t) for all s, t G G; the value n is called the degree of 
the representation and is denoted d p . For example, if j G {0, 1, . . . , n — 1}, 
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then Pj (k) = [ e 2 ^ k l n ] for k G Z n is a representation of Z n . For any group 
G, the representation p(s) = [1] for all s G G is called the trivial representa- 
tion. A representation is said to be irreducible if there is no proper nontrivial 
subspace W of C n (where n = d p ) such that p(s)W C IV for all sGG. If 
there exists an invertible complex matrix A such that Ap\{s)A~ 1 = p2{s) for 
all s G G, then the representation px and p2 are said to be equivalent. It 
can be shown that each irreducible representation is equivalent to a unitary 
representation. We shall assume that when we pick an irreducible represen- 
tation up to equivalence, we pick a unitary representation. It can be shown 
that |G| = J2 p d 2 p where the sum is over all irreducible representations of G 
up to equivalence. 

We define the Fourier transform 

sec 

The following lemma, known as the Upper Bound Lemma, is due to Diaconis 
and Shahshahani jlj and is frequently used in studying probability on finite 
groups. The description here is based on the description in Diaconis j^j. 

Lemma 1 Let P be a probability on a finite group G and U be the uniform 
distribution on G. Then 

\\P ~U\\ 2 <\j^d p Tr{P{p)P{pT) 

p 

where the sum is over all non-trivial irreducible representations p up to equiv- 
alence and * of a matrix denotes its conjugate transpose. 

4.2 Upper bounds for random random walks on Z n 
where n is prime 

A result shown in Hildebrand [TJ] (and based upon a result in [T3]) is the 
following. 

Theorem 6 Suppose k is a fixed integer which is at least 2. Let pi,i = 
1, . . . , k be such that Pi > and J2i =i Pi = 1. Let e > be given. Then for 
some values N and 7 > (where N and 7 may depend on e, k, p%, . . . , pk, but 
not n), 

E{\\PZ.,a k ~ U\\) < * 
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for m = |_^yri 2// C fc—1 ) J for prime numbers n > N. The expectation is over 
a uniform choice of k-tuples (a 1; . . . , a^) G G such that a\, . . . , a& are all 
distinct. 



Proof: This presentation is based upon the ideas in the proof in 
First the result of the following exercise means that we may use the Upper 
Bound Lemma. 

EXERCISE. Suppose that given e' > 0, there exists values 7' > and N' 
(which may depend on e', k,pi, ■ ■ - Pk, but not on n) such that 

^(ii^r..,a fe -^ii 2 )<^ 

if m — [yn 2 ^ k ^ 1 ^ \ and n is a prime which is greater than N' where the 
expectation is as in Theorem |U1 Then Theorem El holds. 

The following proposition is straightforward, and its proof is left to the 
reader. Note that by abuse of notation, we view the Fourier transform in 
this proposition as a scalar instead of as a 1 by 1 matrix. 

Proposition 2 

\P ai ,...,a k {j)\ 2 = I ^2p 2 i 1+2 PhPh cos(27r(o il - a h )j/n) 

\i=l / l<i!<f;2<fc 

where P ai ,...,a k (j) = P ai ,...,a k (Pj) ■ 

In the rest of the proof of Theorem EJ we shall assume j ^ since the 
j = term corresponds to the trivial representation, which is not included 
in the sum in the Upper Bound Lemma. 

Let's deal with the case k = 2 now. We see that 

Pai,a 2 {j) = (1 - 2piJ9 2 ) + 2p x p 2 cos(2vr(a! - a 2 )j/n). 
Note that (ai — a 2 )j mod n runs through 1, 2, . . . , n — 1. Thus 

n— 1 n— 1 

El^O')! 2 ™ = E^ 1 " 2piP2 + 2 Pl p2 cos(2nj/n)) m 
j=i 3=1 

L(n-l)/2j 

< 2 exp(— cj 2 m/n 2 ) 

i=i 
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< 2 exp(— cjm/n 2 ) 

^ exp(— cm/n 2 ) 
1 — exp(— cm/n 2 ) 

for some constant c > 0. (This argument is similar to one in Chung, Diaconis, 
and Graham pQ.) For some 7 > 0, if m = |_7^ 2 J ; then H-P^" 1 ^ — U\\ < e for 
sufficiently large primes n uniformly over all a±, a 2 G Z n with a\ 7^ a 2 . 

From now on in the proof of Theorem El we assume k > 3. Note that 
\Pai,...,a h (j) \ 2 > and that if cos(27r(a il — a i2 )j/n) < 0.99 for some i\ and i 2 
with 1 < i x < i 2 < k, then \P ai ,...,a k {j)\ 2 < h ■= ^ ~ 0.02 min^^ p h p i2 . 

EXERCISE. If m = \jn 2 ^ k ~^\ where 7 > is a constant, show that 
lim^oonfe™ = 0. 

Thus we need to focus on values of ai, . . . , a& such that cos(27r(aj 1 — 
cii 2 )j/n) > 0.99 for all i\ and i 2 with 1 < i\ < z 2 < k. In doing so, we'll focus 
on the case where i\ = 1. 

Let ^nt^) = x where x G (— n/2, n/2] and x = x (mod n). Thus 
cos(2-Kx/n) = cos(27r<7 n (x)/n). The following lemma looks at the probability 
that 

(g n ((ai ~ 02) j)/n, . . .,g n ((ai - a k )j)/n) 
falls in a given (A; — l)-dimensional "cube" of a given size. 

Lemma 2 Suppose k > 3 is constant. Let e > be given. Then there exists 
a value Nq such that if n > No and n is prime, then 

P (m l (e/2) 1 ^- 1 ^ k - 2 ^ k - 1 ^/(2n) < g n (( ai - a t )j)/n 

< (m, + l)(e/2) 1 /( fc - 1 ) n (*- 2 )/( fc - 1 ) /(2n), i = 2,...k) 

< 1-1(^/2) 

~ 2 fc -% 

/or each (m 2 , . . . , m^) G Z^" 1 and j G {1, . . . , n — 1}. 

Proof: Observe that if n is prime and odd, then g n {{a\ — di)j) may be 
any of the values {—n + l)/2, . . . , —2, —1, 1, 2, . . . , (n — l)/2 except for those 
values taken by g„((ai — a^)j) for z' < i Furthermore, different values of 
Oj correspond to different values of g n {{a>\ — o>i)j)- Note that this statement 
need not hold if n were not prime or if j were 0. 
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On the interval [a, b] , there are at most b — a + 1 integers. Thus on the 
interval 

m i (e/2) 1 /( fc - 1 )n( fc - 2 )/( fc - 1 ) (m 4 + i)( e / 2 )i/(fc-i) n (fc-2)/(fc-i) 



there are at most l + (e/2) 1 /( A: 2 ^^ k ^/2 possible values of g n ((0'i — o-i)j)- 

Thus the probability in the statement of the lemma is less than or equal 

to 

(1 + (e/2) 1 /(fc-D n (^ 2 )/( fc - 1 )/2)^ 1 ( e /2) 
(n - l)(n - 2) . . . (n - k + 1) 2 fe -% 

where f(n) ~ g(n) means lim^oo f(n)/g(n) = 1. The lemma follows. □ 
EXERCISE. Explain why the proof of the previous lemma fails if = 2 
(even though this failure is not acknowledged in BP- 

Next we wish to find an upper bound on |-P aii ...,a fc (j)| 2m for (g n (( a i — 
a 2 )j)/n, . . . ,g((ai — ak)j)/n) in each such [k — l)-dimensional "cube". Note 
that there is a constant C\ G (0,1] such that if cos(27r/c 1 /n) > 0.99, then 
cos(27r/ci/n) < 1 — (ci/2)(g n (ki)) 2 /n 2 . Now let l n be largest positive integer 
I such that 

' l[el2) x ^ k -^n^-^l^- x y 



COS 2lT 



2n 



> 0.99 



and 



£( e / 2 )V(*-i) n (fc-2)/(*-i) i 
2n < 4 



Now observe that if m 8 G [— i n — 1, £ n ] and 



2n 



< 



< 



ri 



(m i + l)(e/2) 1 /(fc-i) n (fe-2)/(fc-i) 
2n 



then 



cos^^a.^— a i2 )j/n) < max ( 0.99, 1 — Ci 
Thus 



(min(|m i |,|m i + l|)) 2 (e/2) 2 /( fc - 1 ) 



5/"? 



2/(fc-l) 
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1.1(6/2) 



s \ m 

(mindmiUmi + ll))^) 2 /^-!) 



x(l-Ci(minp llP!2 )^ j 

i=2 

l.l(e/2) 



= 6™ + 2 fc - 1 ^ 



mie[0,^„],i=2,...,fe 



* m 2 (e/2) 2 /( fc - 1 ) 



Since 



i=2 



m 2( e / 2 )2/(fc-l) ^ ! 



4 n 2/(*-i) 16 ' 

Ci < 1, and minj^jj p^p^ <l/k,we may conclude that 

^ m 2 (e/2) 2 /( fe - 1 ) 



/ \ " m 2( e / 2 )2/(fc-l) 

Cl (mig ftlP<a j^ 4n2/(fc _ 1} <1. 



Thus for some constant c 2 > 0, 



( ■ \f4/2) J/M 
1-d (minft lfta j^ 4w2/(fc _ 1} 

f ^ m 2 (e/2) 2 /( fe - 1 ) 

\ i=2 



Thus 

B(\K „ ( (j)| 2ra ) 



( e /2)2/(*-i)' 



fc 



< 6$» + £ 1.1- exp -mc 2 £ 



m i 6[0,oo),i=2,...,fc \ i=2 



l.le\ / / (e/2) 2 /( fe 



b? + (— / 1 - exp -mc 2 



c-l) 
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fc-i 



For some constant 7 > and m 



L 7n 2/(fe-i)j 




( e /2)2/(fc-D 



) 



) 



fc-1 



lim I 1 — exp I —mc2 



4n 2/(fc-l) 



> 0.7. 



■n- 



Thus 



E(\p ai ,., ak u)r)<bT + 



0.9e 



e 

< - 

n 



n 



for sufficiently large n, and the theorem follows from the Upper Bound 



4.3 Random random walks on Z n where n is not prime 

Dai and Hildebrand JS] generalized the result of Theorem |H1 to the case where 
n need not be prime. One needs to be cautious in determining which values 
to pick for aj., . . . , Ofc. For example, if n is even and a 1; . . . , a k are all even, 
then X m can never be odd. For another example, if n is even and ax, ■ ■ ■ ,a k 
are all odd, then X m is never odd if m is even and X m is never even if m 
is odd. In both cases, \\Pa™ ak ~~ ^11 ~h as m —>■ 00. Furthermore, if 
you choose (ax, . . . , a k ) uniformly from G k , there is a l/2 fc probability that 
ai, . . . , 0^ are all even and a l/2 k probability that a±, . . . , a& are all odd. 
The following exercises develop a useful condition. 

EXERCISE. Let a%, . . . , 0^ G {0, . . . , n — 1}. Prove that the subgroup of 
Z n generated by {a 2 — ai , 03 — a\ , . . . , — a\ } is Z„ if and only if (a 2 — a x , a 3 — 
a±, . . . , afe — ax, n) = 1 where (61, ... , 6^) is the greatest common divisor of 
&!,...,£>£ in Z. 

EXERCISE. Prove that ||P a *^.. iafc - C/|| -»• as m -»• 00 if and only if the 
subgroup of Z n generated by {a 2 — ax, ■ ■ ■ , Ofe — ax} is Z„. (Hint: X m equals 
m times ai plus some element of this subgroup.) 

The main result of [2 is 

Theorem 7 Let k > 2 be a constant integer. Choose the set S := {ax, ■ ■ ■ , ctfc} 
uniformly from all subsets of size k from Z„ such that (02 — ax, ■ ■ ■ , Ofc — 
ax,n) = 1 and ax, ■ ■ ■ , a k are all distinct. Suppose px, ■ ■ ■ ,Pk are positive con- 
stants with Yli=xPi = 1- Then E(\\P*™ \ — U\\) — > as n — >• 00 where 
m := m(n) > ^(r?,)??, 2 /^ -1 ) and cr(n) zs any function with cr(n) -> 00 as 
n — >• 00. T7ie expected value comes from the choice of the set S. 



Lemma. 



□ 
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The case k = 2 can be handled in a manner similar to the case k = 2 
for n being prime. So we assume k > 3. Also, we shall let e > be such 
that l/(k — 1) + (k + l)e < 1 throughout the proof of Theorem As in 
the proof of Theorem El we can use the Upper Bound Lemma to bound 
E (\\ p a™...,a k ~ U\\ 2 ). We may write P instead of P ai ,...,a k - 

We shall consider 3 categories of values for j. The proofs for the first 
and third categories use ideas from j2] . The proof for the second category at 
times diverges from the proof in [2|; the ideas in this alternate presentation 
were discussed in personal communications between the authors of [2|. 

The first category has J\ := {j : (j,n) > n^ k ~ 2 ^'^ k ~ 1 ' +e and 1 < j < n— 1}. 
In this case, we have the following lemma. 

Lemma 3 ^2j eJl |-P(j)| 2m — > as n — > oo for m > a^n 2 ^^ 1 ^ where 
u{n) — > oo as n — > oo. For a given a(n), this convergence is uniform over all 
choices of the set S where a%, . . . , are distinct and (02 — ai, . . . , a^— a±, n) = 
1. 

Proof of Lemma: Observe that if n divides ja^ — ja\ for all h — 2, . . . , k, 
then n would divide j since (02 — a\, ■ ■ ■ , dk — ai, n) = 1. So for some value 
h G {2, . . . , k}, n does not divide jah — ja\. Let uj = e 2n ^ n . Thus, with this 
value of h, we get 

\P(j)\ = \ Pl u j ^ + ...+p k u jak \ 

< 1 - 2min(pi,p /l ) + mm(p 1 ,p h )\uj jai + u jah \ 
= 1 - 2min(pi,p fe )(l - | cos(nj(a h - ai)/n)|) 

< 1 - ca 2 /n 2 

where a := (j, n) and c > is a constant not depending on S. To see the last 
inequality, observe that since j(dh — 01) ^ (mod n), we get (j/a)(ah — 
ai) ^ (mod n/a) and (j/a)(a/ l — a x ) G Z. Thus | cos(7rj(a^ — ai)/n)\ < 
cos(7ra/n). 

The proof of the lemma is completed with the following exercise. 

EXERCISE. Show that for m in the lemma and with a > 7#~ 2)/(A: ~ 1)+e , 
we get (1 — ca 2 /n 2 ) m < ciexp(— n 2e ) for some constant c\ > and n(l — 
ca 2 /n 2 ) 2m — ► as n — > 00. 

□ 

The next category of values of j is J2 := {j : (J, n) < n^ _2 -'^ fc_1 ^ _e and 
1 < J < n- 1}. 
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Lemma 4 J2 jeJ2 E(\P(j)\ 2m ) — > if m > a(n)n 2 ^ k ^ where cr(n) — > oo as 
n — > oo where the expectation is as in Theorem^ 

To prove this lemma, we use the following. 

Lemma 5 X!jej 2 ^(1-^0) | 2m ) ~ > if m > a(n)n 2 ^ k ~^ where a(n) — > oo as 
n — > oo where the expectation is over a uniform choice of (a\, . . . , a^) G G . 

Proof of Lemma 03 Although Dai and Hildebrand [2] used a different 
method, the proof of this lemma can proceed in a manner similar to the 
proof of Theorem El for k > 3; however, one must be careful in proving 
the analogue of Lemma 121 Note in particular that instead of ranging over 
-(n - l)/2, . . . , -2, -1, 1, 2, . . . , (n - l)/2, the value g n {{a x - a^j) ranges 
over multiples of (j,n) in (— n/2, n/2]. Furthermore, distinct values of Oj 
need not lead to distinct values of g n {{a\ — a,j)j). 

EXERCISE. Show that Lemma El still holds if n is not prime but j G J 2 
and (ai, . . . , a^) are chosen uniformly from G k . Then show Lemma El holds. 

□ 

To complete the proof of Lemma EJ note that if d is a divisor of n and 
(ai, . . . , a&) is chosen uniformly from then the probability that d di- 
vides all of a 2 — ai, . . . ,a k — a x is l/d fc_1 . Thus, given n, the probability 
that a-i — ai, . . . , Ofc — a\ have a common divisor greater than 1 is at most 
T,7=2 d ~ [k ~ l) < (^V 6 ) — 1 < 1 if & > 3. Also observe that the probability 
that a duplication exists on a\, . . . , a k approaches to as n — > 00. 

EXERCISE. Show that these conditions and Lemma El imply Lemma EJ 

□ 

The last category of values for j is J3 := {j : n^ k ~ 2 '^ k ~^~ e < (j,n) < 
ri M/( fc - 1 )+ e and 1 < j < n - 1}. 

Lemma 6 X^eJ 3 2m ) ~ * m — o-{n)n 2 ^ k ^ with a(n) — > 00 as 

n — > 00 and unia iae expectation as in Theorem^ 

Proof: Since IIP*™ n ~ U\\ = WPn 1 ! „, „, „ — C/||, we may assume 

II ai,a2,...,afc II II U,a2— ai,...,afe— ai ID J 

without loss of generality that ai = 0. Hence we assume (a 2 , . . . , a k , n) = 1. 
Let (sc) denote the distance of 2 from the nearest multiple of n. If (jag) > 
n (k-2)/(k-i)+e^ then by reasoning similar to that in the proof of Lemma El 
we may conclude that \P(j)\ 2m < Ciexp(—n 2e ) for some constant c± > 0. 
Otherwise {jag) < n( fe ~ 2 )/( fe ~ 1 ) +e for £ = 2, ... k; let B be the number of {k — 
l)-tuples (a 2 ,...,a fc ) satisfying this condition. Since (j, n) < riA fe ~ 2 )/( fc ~ 1 - )+e , 
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we may conclude by Proposition |3] below that for some positive constant c 2 , 
we have B < c 2 (n (fe - 2) ' . Thus 

E(|P(j)| 2m )<c 1 exp(-^)+ D 



Tn k 1 b(n) 

where T := 1 — Y^^=2^ anc ^ K n ) * s the probability that (02, . . . , a^) 
when chosen at random from has no coordinates and no pair of 

coordinates with the same value. Note that b(n) —>■ 1 as n — > 00. Thus 
P(|P(j)| 2m ) < Ci exp(— n 2e ) + C3n( fc_1 ) e-1 for some constant c 3 > 0. 

Let D be the number of divisors of n. By Proposition 0] below, D < c^n 6 
for some positive constant C4. Also, if a divides n, then there are at most 
n/a natural numbers in [l,n — 1] with (j,n) = a. For j G J3, 

- < n = n V(fc-i)+« 

fl - n (fc-2)/(fc-l)- e 

Thus 

^ P(|P(j)| 2m ) < c 4 n e n 1/(fc ~ 1)+£ (ciexp(-n 2e ) + can**" 1 ^ 1 ) -> 
jeJ 3 

as n — > 00 if m > n 2 ^ fe_1 V(n). Note that we used l/(fc — 1) + (k + l)e < 1 
here. □ 
We need two propositions mentioned above. 

Proposition 3 If (j,n) < b with j 6 {1, . . . ,n — 1}, then the number of 
values a in 0,1, ... ,n — 1 such that (ja) < b is less than or equal to 3b. 

The proof of this proposition may be found in [2] or may be done as an 
exercise. 



Proposition 4 For any e with < e < 1, there is a positive constant c = c(e) 
such that d(n) < cn e for any natural number n where d(n) is the number of 
divisors of n. 

Proof: Suppose n = p^ 1 . . .p^ r where pi, . . . ,p r are distinct prime num- 
bers and di, . . . , a r are positive integers. Then d{n) = (a! + l)(a 2 + l) . . . (a r + 
1). Note that a\, a 2 , ■ ■ ■ here are not the values selected from Z n and pi,p 2 , ■ ■ ■ 
are not probabilities! Let M = e 1/e . If p { > M, then (p? ) e > ((e 1/€ ) a *) e = 
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e ai > 1 + Oj. If p 4 < M, then (pf ) e > 2 a > e = e ea * log2 > 1 + eai\og2 > 
e(log2)(l + a i ). Thus 




> J] e(log2)(l + a i ) x J] (1 + a,) 

Pi<M Pi>M 
r 

> (elo g 2) M n( 1 + ^) 

i=i 

since elog2 < 1. Thus n e > (e\og2) M d(n) and c?(n) < cn e where c = 
(elog2)- M □ 
EXERCISE. Give a rough idea of what c is if e = 0.1. (Hint: It's ridicu- 
lously large!) 

PROBLEM FOR FURTHER STUDY. Give an argument so that Lemma© 
or Theorem [7| does not need such a ridiculously large constant. 



4.4 Dou's version of the Upper Bound Lemma 

The Upper Bound Lemma of Diaconis and Shahshahani is particularly useful 
for random walks on abelian groups or random walks where P is constant on 
conjugacy classes of G. Dou [5] has adapted this lemma to a form which is 
useful for some random random walks. This form was used in [5] to study 
some random random walks on various abelian groups, and Dou and Hilde- 
brand jB] extended some results in |3] involving random random walks on 
abelian groups. Dou's lemma is the following. 

Lemma 7 Let Q be a probability on a group G of order n. Then for any 
positive integer m, 

4||Q* m - uf < "QM ■ ■ ■ Q^2m) - ■ ■ ■ Q( x ^) 

where G 2m is the set of all 2m-tuples (xi, . . . , X2 m ) with X{ G G and Q 
is the subset of G 2m consisting of all 2m-tuples such that X\X^ ■ ■ ■ x m = 
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Proof: The proof presented here uses arguments given in [Sj and [U]. 
Label all the non-equivalent irreducible representations of G by pi, . . . , ph- 
Assume ph is the trivial representation and the representations are all uni- 
tary. Let Xij • • • j Xh be the corresponding characters and d\, . . . , d% be the 
corresponding degrees. Note that Pi(x)* = (pi(x))~ l = pi(x~ l ) for all x G G 
since pi is unitary. Thus 



Q{pi) m = ^2 Qi x i) ■ ■ -Q{ x m)pi{xi. ■ .x m ) 

X\ ,. . -,Xm 

and 

{Q{pi) m y = ^ Q( x m+i) ■ ■ ■ Q(x 2m )pi((x m+1 . . .x 2m y 1 )) 



-l 



Thus if s = {xx . . . x n )(x m+ i . . . x 2m ) , we get 
h-i h-i 



Y,d l Tr{Q{p l ) m {Q{p l ) m Y) = $^Q(*i)...Q(x 2m )cte(*) 

i=l c 2m 

h-l 

^2 Q( x l) ■ ■ ■ Q( x 2m) ^2 di *i( s ) 



i=l i=l G 2m 

h-l 



G 2m i=l 

Note that dhXh(s) = 1 for all s G G and 

h 



i=l 



n if s — e 
otherwise 



where e is the identity element of G. The lemma follows from the Upper 
Bound Lemma. □ 
To use this lemma, we follow some notation as in [H] and [U]. We say a 2m- 
tuple (xi, . . . , X2m) is of size i if the set {x±, . . . , X2 m } has i distinct elements. 
An i-partition of {1, . . . , 2m} is a set of i disjoint subsets r = {Ai, . . . , A«} 
such that Ai U . . . U Aj = {1, . . . , 2m}. An i-partition of the number 2m 
is an i-tuple of integers 7r = (p 1( . . . ,pi) such that p\ > . . . > pi > 1 and 

Note that each 2m-tuple in G 2m of size i gives rise to an z-partition of 
2m in a natural way. For 1 < j ' < i, let Aj C {1, . . . , 2m} be a maximal 
subset of indices for which the corresponding coordinates are the same. Then 
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Ai, . . . , A, form an i-partition of {1, . . . , 2m}; we call this i-partition the 
type of the 2m-tuple. If |A X | > ... > |Aj|, then tt = (|Ax|, . . . , |Aj|) is an 
z-partition of 2m, and we say the type r corresponds to tt. 

EXAMPLE. If v = (0,11,5,5,1,3,0,5) G Z? 2 , then the type of v is 
r = {{3, 4, 8}, {1, 7}, {2}, {5}, {6}} and the corresponding 5-partition of the 
number 8 is tt = (3, 2, 1, 1, 1). 

Now suppose that r = {A 1; . . . , Aj} is a type corresponding to a partition 
tt of 2m. Let N n (r) be the number of 2m-tuples in Q of type r. 

A little thought should give the following lemma. 

Lemma 8 N n (r) is the number of i-tuples (y\, . . . ,yi) with distinct coordi- 
nates in G that are solutions to the induced equation obtained from x\ . . . x m = 
x m+ i . . . X2m by substituting yj for xe if £ G Aj . 

EXAMPLE. If r = {{3, 4, 8}, {1, 7}, {2}, {5}, {6}}, then this equation is 
3/23/32/1 = 3/43/52/23/1- 

EXERCISE. Suppose v = (0,3,4,1,5,1,4,5,3,3) G Z\° 2 . Find the type 
r of v. Then find the value % and the induced equation described in the 
previous lemma. 

We can adapt Lemma [7| to prove the following lemma. The lemma and 
its proof are minor modification of some material presented in [3] and In 
particular, the argument in [3] covered a broader range of probabilities Q. 

Lemma 9 Suppose (ax, ... , a^) are chosen uniformly from all k-tuples with 
distinct elements of G. Also suppose that Q{ai) = 1/k. Then 

min(fc,2m) , , 

e(\\q™ - u\\') < J2 

i=l 7reP(i) L J * rGT(Tr) 

where [n]i = n(n — 1) . . . (n — i + 1), P(i) is the set of all i-partitions of 2m, 
and T(ir) is the set of all types which correspond to tt. 

Proof: Suppose 7r is an i-partition of 2m. A 2m-tuple of 7r is defined 
to be a 2m-tuple whose type corresponds to tt, Let Di(ir) be the set of all 
2m-tuples of it in Q, and let -D 2 (vr) be the set of all 2m-tuples of it in G 2m . 
Thus |£>i(tt)| = EreT W ^(r) and |D 2 (tt)| = E t£ t W M -( r ) where M *( T ) 
is the number of 2m-tuples of type r in G 2m where tt is the corresponding 
i-partition of the number 2m. It can readily be shown that M 7r (r) = [n],. 
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Observe from Lemma [7| that 

2m I 

4E(\\Q* m - U\\ 2 ) < EE E nE(Q( Xl )...Q(x 2m )) 

i=l 7reP(i) \(x 1 ,...,x 2 m)&D 1 (w) 

E ^(Q(xi)...g(a; 2w )) 

(xi,...,X2 m )GD 2 (7r) 

Now let's consider ^((^(xi) . . .Q(x2 m ))- This expectation depends only 
on the size i of (xi, . . . , x<i m )- The probability that a given i-tuple (yi, ■ ■ ■ ,yi) 
with distinct elements of G is contained in a random sample of G is [&]j/[n]j. 
Thus 

E(Q(x 1 )...Q(x 2m )) = ^ [ ^ 

Note that if the size of (xi, . . . , x<i m ) is greater than k, then Q{x\) . . . Q(x2 m ) 
must be 0. 
Thus 



fc 2m | 




1 




k 2m 


[n]i 


1 





aseZ)i(ir) ' L J tST(tt) 

and 

E ^(Q(x!)...g(x 2m )) 

xeD 2 (ir) " l '~ j 't6T(tt) 

/,2,» [„1 E M' 

The lemma follows by substitution and easy algebra. □ 
Next we consider a result in Dou [5]. The next theorem and its proof 
essentially come from 5J but use a simpler and less general expression for 
the probability P. 

We assume that G is an abelian group with n elements such that n = 
Hi . . . rit where n\ > . . . > n t are prime numbers, t < L for some value L not 
depending on n, and n\ < An t for some value A not depending on n. 

Theorem 8 Suppose G satisfies the conditions in the previous paragraph 
and k > 2L + 1 is constant. Suppose (a 1; . . . , a&) is chosen uniformly from 
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k-tuples with distinct elements of G. Then for some function f(n) — > as 
n — > oo fwt/i /(^) not depending on the choice of G) 

E(\\PZ l .., ak -U\\)<f(n) 

where m = c(n)n 2 ^ fc_1 ^ where c(n) — > oo as n — > oo andpi = . . . = p^ = l/k 
so that Pai,...,a k {s) = 1/k if s = di for some i in 1, . . . , k. 

Proof: Without loss of generality, we may assume that 
c(n) < n (Vi)-(2/(fc-i)) A -i+(i/i). 

We may use Lemma 01 Let 

ft=EE £ <»w.m - wo. 

i=l vrGP(i) L J * rGT(Tr) 

It can be readily shown from Lemma El that tlN^t) — [n]i < n[n]i. Thus 

Bi < y y t^tt y 

- fc2m n L 

i=l vrgP(j) 1 J reT(7r) 

^ fc-1 
1=1 

where 52m,i is a Stirling number of the second kind; this number is the number 
of ways to place 2m labeled balls in % unlabeled boxes such that there are no 
empty boxes. 

EXERCISE. Show that (k - l) 2m = J2i=l[k ~ l]Am,i. (Hint: The left 
side is the number of ways to place 2m labeled balls in k — 1 labeled boxes 
where some boxes may be empty.) 

Observe that [k} { = k[k - l} t /(k - i) < k[k - l] t if i < k - I. Thus 
B\ < k{l / k 2m )n{k — l) 2m — > as n — > oo for the specified m. 

Now let 

where the sum is over all fc-tuples r, i.e. the set of all fc-partitions of the set 
{1, 2, . . . , 2m}. We use the following lemma (which, along with is proof, is 
based upon [5]). 
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Lemma 10 If G is an abelian group satisfying the conditions for Theorem^ 



then for each k-type r, either N n (r) = [n]k or N„(t) < [n]k-i. If T\ = 
{k — types r\N n (r) = [n]k} and T 2 = {k — types r|A^ 7r (r) < [n]fc_i} ; then 
\Ti \ + \T 2 \ = S 2m ,k and 



Proof: We start with an exercise. 

EXERCISE. Show that the conditions on G and the restrictions on c(n) 
imply that m < n t . 

By Lemma |Hl N n (r) is the number of fc-tuples (yi, . . . ,yk) with distinct 
coordinates such that \\y\ + . . . + XkVk — for some integers Ai, . . . , \k with 
I Ai| < m < n t . Note that here we are using the fact that G is abelian. Also 
note that Ai is the number of times is substituted for Xj with 1 < j < m 
minus the number of times yi is substituted for Xj with m + 1 < j < 2m; 
in other words, Ai = |Aj PI {1, ... , m}\ — |Aj fl {m + 1, . . . , 2m}|. If Ai = 
. . . = Afc = 0, then N n (r) = [n]k\ otherwise if Xj ^ for some j, then yj is 
solvable in terms of the other variables in yi,---,yk since m < p t and thus 
-A^-(t) < [n]fc_i. Thus we may conclude that Ai = . . . = A^ = if and only if 



r = {A[UA'{, AJ.UA"} where r' = {A[, . . . , A'J and r" = {A'{, A{} 



are fc-types of {1, ... , m} and {m + 1, . . . , 2m} respectively with | AJ| = | A'-\ 
for % = 1,2, ... ,k. The inequality |Ti| < K mj k is elementary. The equality 
|?i I + l^2| = S>2m t k follows quickly from the definitions of S 2 m t k, T x , and T 2 . 



and m = c(n)n 2 ^ k ^ where c(n) 



00 as n 



00 such that 



^ n ) <n (yL)- { 2/ {k -l)) A -lHl/L)^ 




The lemma is thus proved. 

Thus B 2 < B 2 i + B 2 2 where 



□ 




and 
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Note that in denning -82,2, we used the fact that n[n]fc_i — [n] k = [n}k-i(k — 1). 
Now observe that 

£2,2 < (k-l)-^[k) h \T 2 \/(n-k + l) 

< (k - l) — [k} k S 2m ,k/(n- k + 1) 

< (k-^^/(n-k + l) 

since S 2rnjk < k 2m /k\ because k 2m is the no more than the number of ways to 
place 2m labeled balls in k labeled boxes where no box is left empty. Thus 
-82,2 — ► as n — > 00. 
We also have 

Bv < j^[kUn-l)\Ti\ 

- -tf^\ k \k{n - l)K mtk 

< ^[kHn-l)c k 2m /m^/ 2 

since an appendix of j3] proves K m>k < c$k 2m /rnS^ 1 '' 2 for some positive 
constant c . Thus for some value c which may depend on k but not n, we 
get B 2 \ < c(n — 1) / 'm^ -1 )/ 2 . The theorem follows. □ 
PROBLEM FOR FURTHER STUDY. The restrictions on G in Theo- 
rem |H1 seem excessive, but we used the fact that m < n t to bound |Ti|. 
Perhaps arguments can be made for a broader range of G to deal with some 
cases where we do not have this fact. Indeed, similar squares of multino- 
mial coefficients, along with some additional terms, appear in the argument 
which Dai and Hildebrand [2] use to prove Lemma El described earlier; this 
proof might serve as a starting point for a possible proof of an extension of 
Theorem |SJ 

It should be noted that Greenhalgh ^1] has also used arguments involving 
squares of such multinomial coefficients to prove results similar to Theorem|Hl 

Further results using these techniques appear in Dou and Hildebrand 6 . 
In particular, the following two theorems are shown there; their proofs will 
not be presented here. 

Theorem 9 Suppose G is an arbitrary finite group of order n and k = 
L(logn) a J where a > 1 is constant. Let e > be given. Suppose (a 1; . . . , a k ) 
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is chosen uniformly from k-tuples with distinct elements of G. Then for some 
function f(n) — > as n — > oo (with f(n) not depending on the choice of G), 

E{\\PZ.,a k -U\\)<f{n) 

if 

a logn 

m = m(n) > -(1 + e). 

a — 1 log k 

Theorem 10 Suppose G is an arbitrary finite group of order n. Also suppose 
k = \_a\ogn\ and m = [olognj where a and b are constants with a > e 2 , 
b < a/4, and 61og(e6/a) < —1. Suppose (a 1; . . . , a^) is chosen uniformly 
from k-tuples with distinct elements of G. Then for some function f(n) — > 
as n — > oo (with f(n) not depending on the choice of G), 

E(\\P:Z,a k -U\\)<f(n). 

Roichman [20] uses spectral arguments to get results similar to these 
theorems and to extend them to symmetric random walks where at each 
step one multiplies either by cij or by a^ 1 (with probability 1/2 each) where 
i is chosen uniformly from {1, . . . , k}. 

4.5 Extensions of a result of Erdos and Renyi 

Some early results involving probability on finite groups appear in an article 
of Erdos and Renyi |7j. In it, they give the following theorem. 

Theorem 11 Suppose k > 2 log 2 n+2 log 2 (l/e)+log 2 (l/£) and J = (ai, . . . , a^) 
is a random k-tuple of elements from an abelian group G of order n. Ifb e G, 
let Vkib) be the number o/(ei, . . . , e^) G {0, l} h such that b = t\ai + . . . + eka k . 
Then 

e— )> 1 - 5. 
n J 

Near the end of their paper, Erdos and Renyi note that this theorem can 
be generalized to non-abelian groups G n of order n by counting the number 
of ways an element b can be written in the form b = ai 2 . . . ai r where 
1 < %\ < ii < . . . < i r < k and < r < k. They find it unnatural to assume 
that if i < j that would have to appear before aj. They also assert that 
if we "do not consider only such products in which i\ < i 2 < . . . < i r , then 



Pr ( max 

6GG 



V k (b) 



2 k 

n 
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the situation changes completely. In this case the structure of the group G n 
becomes relevant." 

Further results by Pak JH] and Hildebrand ^2] built upon this result in 
[7j and its extension to non-abelian groups to get results for random "lazy" 
random walks on arbitrary finite groups. These "lazy" random walks are 
such that at each step, there's a large probability that the walk stays at 
the same group element. These results, despite the assertion of |7, do not 
depend on the structure of the group G and involve products of the form 
a^a^ . . . a ir where ii, i 2 , . . . , i r need not be in increasing order and may be 
repeated. 

For the next two theorems, which come from [T^J, we use the following 
notation. If J = (ai, . . . , a k ) G G k , then 

P(s) = Pj{s) = : a, = s}\ + -6 {s=e} 

where 5{ s=e } is 1 if s is the identity e of G and otherwise. Note that 
this expression is different from the expression P ttl 0fc (s) in the rest of this 
article. 

Theorem 12 Suppose a > 1 and e > are given. Let k = |~alog 2 n~|. 
Suppose m = m{n) > (1 + e)a log(a/(a — 1)) log 2 n. Then for some function 
fi(n) — > as n — ► oo (where fi{n) does not depend on which group G of 
order n is being considered), E(\\P* m — U\\) < fi{n) as n — > oo where J is 
chosen uniformly from G k . 

Theorem 13 Suppose k = log 2 n + f(n) where f(n) — > oo as n — > oo and 
f(n)/\og 2 n — > as n — > oo. Let e > be given. If m = m(n) > (1 + 
e)(log 2 n)(log(log 2 n)), then for some function f2(n) — > as n — >• oo (where 
/ 2 (ra) does noi depend on which group G of order n is being considered) , 
E(\\P* m — U\\) < fzin) where J is chosen uniformly from G k . 

The proofs of Theorems ^] and EI] use the following variation of Theo- 
rem El In it, note that g° is the identity element of G. 

Lemma 11 Let J = (ai, . . . , a k ). Suppose j < k. Let Qj(s) be the probabil- 
ity that s = a^a^ ■ ■ ■ af where ex, e 2 , . . . , e 3 - are i.i.d. uniform on {0, 1}. If 
J is chosen uniformly from all k-tuples (ai, . . . , a&) o/ elements of G, then 
Pr(\\Qj -U\\ <e)>l- 5 for each j > log 2 n + 2 log 2 (l/e) + log 2 (l/5). 
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Proof: This proof follows ^H] and extends a proof in [7] . 
Let Vj(s) = 2 j Qj(s). Observe that 



M\Qj-u\\ : 



E 

sGG 

< »E 



2-i 



YM 

7? 



by the Cauchy-Schwarz inequality; this argument is very similar to part of 
the proof of the Upper Bound Lemma described in Chapter 3 of Diaconis [3] . 
Thus 



Pr{2\\Qj-U\\ > e) < PrlnJ^l 
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It can be shown (as on p. 130 of [7j extended to non-abelian groups) that 

2 N 



-0-5) 



where the expectation comes from choosing J uniformly from all /c-tuples 
(ax, ... , flfe) of elements of G. 

Thus by Markov's inequality, we get 

Pr{\\Qj-U\\>e) < Pr(2\\Qj-U\\ > e) 

Til - (l/ n )) 



< 
< 



n 



e 2 23 



e 2 2 2 i/n 
< 5. 



□ 

We say that a family of probability distributions Rj depending on J 6 G fc 
is (a, (3)-good in variation distance if Pr(\\Rj — U\\ > a) < [3 where the prob- 
ability is over a uniform choice of all fc-tuples for J. Thus Lemma fTTI shows 
that al 1 . . . a- is (e, <5)-good in variation distance if j > log 2 n + 2 log 2 (l/e) + 
log 2 (l/5)- 
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Theorems [E?] and look at the variation distance from the uniform 
distribution of a probability distribution of 

«■■■<%: 

where ii, ■ ■ ■ ,i m are i-i-d.- uniform on {1, ... , k}, ex, . . . , e m are i.i.d. uniform 
on {0, 1}, and (ix, . . . , i m ) and (ei, . . . , e m ) are independent. Using Lemma fTTl 
to examine this distribution requires considerable care. 

First let's consider the case where ix, . . . , i m are all given and consist of 
at least j distinct values. Suppose also that the value €£ is given if it = iy for 
some £' < £ or if {ix, . . . , ie-i} has at least j distinct values; in other words, ee 
is given if ig appeared earlier in the m-tuple (ix, . . . , i m ) or if ig is not among 
the first j distinct values in this m-tuple. We assume that the remaining j 
values from ex, ■ ■ ■ , e m are i.i.d. uniform on {0, 1}. For example, if j = 5, 
k = 7, and m = 9, such an expression may look like 

^3 ^4 ^2 ^4^1 ^3^6 ^7^2 

where ei, e 2 , e 3 , e 5 , and e 7 are i.i.d. uniform on {0, 1}. 

To use Lemma fTTl to examine such expressions, we need to consider the 
"pulling through" technique described in Pak [TH] and subsequently in Hilde- 
brand [To] . 

Proposition 5 Suppose h = 3 where ex, ■ ■ ■ , ej are each 

in {0, 1} and x is a fixed function of a\, . . . ,ag. Then 

h = a 1 1 ...af (of +1 ) e<+l ...(oj) ei ar 

where g x := xgx~ l . Furthermore if ax, ■ ■ ■ , clj are i.i.d. uniform on G, then 
ax, ■ ■ ■ ,d£, af+i, ■ ■ ■ , of are i.i.d. uniform on G. 

Proof: The alternate expression for h can be readily verified. Note that 
since x does not depend on ae+i and since ax, ■ ■ ■ , ag, ae +1 are i.i.d. uniform 
on G, the expression xa^ + xx~ l will be uniform on G independent of ax, ■ ■ ■ , ag. 
Continuing in the same way completes the proof of the proposition. □ 

This proposition can be used repeatedly. For example, if 

h — tt^ ^4 ^2 ^4^1 ^3^6 ^7^2 ' 

then 

h = a^afaf « 4 ) £5 « 4a3 ) e? a 4 a 3 a° 7 al. 
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Furthermore, if 03, 0,4, a 2 , a\, and a 6 are i.i.d. uniform on G, then so are a 3 , 
a 4 , a 2 , a" 4 , and ctg 4a3 . Also note that if ai, . . . ,a 7 are given and e%, e 2 , e 3 , 
€5, and £7 are i.i.d. uniform on {0, 1}, then the probabilities P and Q given 
by P(s) = Pr(s = al'afafia^Y^a^Y 7 ) and Q(s) = Pr(s = h) have the 
same variation distance from the uniform distribution. 
Thus we may conclude the following. 

Lemma 12 Suppose I = . . . , i m ) where i\, . . . , i m 6 {1, . . . , k}. Suppose 
I has at least j distinct values where j > log 2 n + 2 log 2 (l/e) + log 2 (l/5) and 
j < k. Suppose e is a vector determining ei if ig = iy for some £' < I or if 
{«!,..., ie-i} has at least j distinct values. Suppose the remaining j values 
from £1, . . . , e m are i.i.d. uniform on {0, 1}. Then a^ 1 . . . a^™ is (e, S)-good in 
variation distance. 

We need to put together probabilities for the various possibilities for / 
and e. The following exercise will be useful. 

EXERCISE. Suppose P = p\P\ + . . . + pePe where p±, . . . ,pe are positive 
numbers which sum to 1 and P\,...,P% are probabilities on G. Show that 

e 

\\P-U\\<J2Pj\\Pj-U\l 

3=1 

The following lemma comes from [15j. 

Lemma 13 Let c > 1 be given. Suppose j is given such that j < k, j > 
log 2 n + 21og 2 (l/a;) + log 2 (l//3) ; and j < m. Suppose that the probability 
of getting at least j distinct values when choosing m i.i.d. random numbers 
which are uniform on {1, . . . , k} is 1 — p(j, k,m). Then Pr(\\P} m — U\\ > 
c(3 + a +p(j, k,m)) < 1/c where the probability is over a uniform choice of 
(ai, . . . ,a k ) e G k . 

Proof: Let / be an m-tuple (ii, . . . , i m ) of elements of {1, . . . , k} and 
J = (ai, . . . , ak) be a /c-tuple of elements of G. Let e be a vector with m — j 
elements of {0, 1}. Let Si be the set of / such that / has fewer than j distinct 
values, and let S 2 be the set of / such that / has at least j distinct values. 

If / G S 2 , consider the probability distribution of a^a^ ■ ■ ■ a iZ wnere e l 
is determined by e if %n — i# for some £' < £ or {ii, . . . , ie-i} has at least 
j distinct values and where the remaining j values from e\, . . . ,e m are i.i.d. 
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uniform on {0, 1}. Let v(I, J, e) be the variation distance of this probability 
distribution from the uniform distribution. By the exercise 

Hp- _ u\\ < y _L i + y y J— j, e ). 

" J " — / j fern / / / -i fern ^m—j v 7 7 ' 

IeSi I&S2 e 

Let 

G(/ ) J,e) = ( 1 MJ.43<« 
1 otherwise 

For each I E S2 and e, the number of J with J, e) = is no more than 
f3 times the total number of J since the family of probability distributions 
a^a-j . . . a\ m (where j of the values ei, . . . , e m are i.i.d. uniform on {0, 1} 
and the rest are determined by e as previously described) is (a,/3)-good in 
variation distance by Lemma E3 For a given J, the number of I G S2 and e* 
with J, e) = may be more than c/3 times the total number of / 6 S% 
and e. However, the number of such fc-tuples J can be at most 1/c times the 
total number of fc-tuples J. For the other choices of J, we have 

\\ p j m - u\\ 

J_ y- _1 1_ X ^ _1 1_ { 

/ j fern / j fern ^m—j / j fern ^m—j 

IeS! (I,e):IeS 2 ,G{I,J,e) = l (I ,e):IeS 2 ,G(I , J,e)=0 

< p(j, k,m) + a + c[3. 

The proof of the lemma is complete. □ 
Using Lemma EH to prove Theorems ^] and EH involves finding a bound 
on p(j, k, n) and choosing c appropriately. The technique to find the bound 
involves the time it takes to choose j out of k objects in the coupon collector's 
problem. More details may be found in Pak ^H] and in Hildebrand ^5] ; these 
sources refer to p. 225 of Feller j^j. 

By using comparison theorems (Theorem 3 and Proposition 7 of Hilde- 
brand JE]), one can extend Theorems and E3 to deal with the cases where 

Pj(s) = —fe—\{ i ■ ai = s}\+ a5 {s=e ) 

if a is a constant in the interval (0, 1) and k is as in those theorems. The 
constant multiple in the expression for m may depend on a. 

PROBLEM FOR FURTHER STUDY. Can these theorems be extended 
to the case where a = for these values of fc? 



< v 
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Hildebrand in jT^j and ^H] also considers some random symmetric lazy 
random walks and again extends results of Pak One of these results 

from is the following. 

Theorem 14 Suppose X m = a^ 1 . . . a^ m where ex,...,e m are i.i.d. with 
P( ti = 1) = P(ei = -1) = 1/4 and = 0) = 1/2. Suppose ii,...,i m 
are i.i.d. uniform on {1, ... ,k} where k is as in Theorem\lc\ Given J G G k , 
let Qsym be the probability of X\. If m = m{n) > (1 + e)(log 2 n) log(log 2 n) ; 
then EQIQ*^ — U\\) ^ as n ^ oo where the expectation is over a uniform 
choice of J = (a 1; . . . , a^) from G k . 

4.6 Some random random walks on 

Greenhalgh uses some fairly elementary arguments to examine random 
random walks on Z 2 , and Wilson uses a binary entropy function argument 
to examine these random random walks. The main result of is the 
following theorem, which we state but do not prove. 

Theorem 15 Suppose k > d. There exists a function T(d, k) such that the 
following holds. Let e > be given. For any choice of a%, . . . , (each from 
if m < (l — e)T(d,k), then \\P ai ,...,a k — U\\ > 1— e. For almost all choices 
of a\, . . . , ak, if m> (1 +e)T(d, k), then \\P ai ,...,a k — U\\ < e provided that the 
Markov chain is ergodic. 

Note that "for almost all choices" a property holds means here that with 
probability approaching 1 as d — > oo, the property holds. Also note that here 
P au ..., ak (s) = \{i : a l = s}\/k. 

Some properties of T(d, k) are described in j2E] and are also mentioned 
on p. 321 of Saloff-Coste j^J. 

Wilson [26 j noted that the upper bound remains valid for any finite 
abelian group G provided that d is replaced by log 2 

PROBLEM FOR FURTHER STUDY. Does the expression for the upper 
bound remain valid for any finite group G provided that d is replaced by 
log 2 |G|? 

PROBLEM FOR FURTHER STUDY. Relatively little is known about 
random random walks on specific families of finite non-abelian groups if 
k < log 2 Indeed, Saloff-Coste [22] (p- 324) cites a wide-open problem 
involving the alternating group with k = 2. 
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